Validation of the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool: a new tool to assess the quality of health information provided by AI platforms.

BACKGROUND: The widespread diffusion of Artificial Intelligence (AI) platforms is revolutionizing how health-related information is disseminated, thereby highlighting the need for tools to evaluate the quality of such information. This study aimed to propose and validate the Quality Assessment of Medical Artificial Intelligence (QAMAI), a tool specifically designed to assess the quality of health information provided by AI platforms. METHODS: The QAMAI tool has been developed by a panel of experts following guidelines for the development of new questionnaires. A total of 30 responses from ChatGPT4, addressing patient queries, theoretical questions, and clinical head and neck surgery scenarios were assessed by 27 reviewers from 25 academic centers worldwide. Construct validity, internal consistency, inter-rater and test-retest reliability were assessed to validate the tool. RESULTS: The validation was conducted on the basis of 792 assessments for the 30 responses given by ChatGPT4. The results of the exploratory factor analysis revealed a unidimensional structure of the QAMAI with a single factor comprising all the items that explained 51.1% of the variance with factor loadings ranging from 0.449 to 0.856. Overall internal consistency was high (Cronbach's alpha = 0.837). The Interclass Correlation Coefficient was 0.983 (95% CI 0.973-0.991; F (29,542) = 68.3; p < 0.001), indicating excellent reliability. Test-retest reliability analysis revealed a moderate-to-strong correlation with a Pearson's coefficient of 0.876 (95% CI 0.859-0.891; p < 0.001). CONCLUSIONS: The QAMAI tool demonstrated significant reliability and validity in assessing the quality of health information provided by AI platforms. Such a tool might become particularly important/useful for physicians as patients increasingly seek medical information on AI platforms.

Repeated Bilateral Transcranial Direct Current Stimulation over Auditory Cortex for Tinnitus Treatment: A Double-Blinded Randomized Controlled Clinical Trial.

Transcranial direct current stimulation (tDCS) is a non-invasive and painless technique of brain neuromodulation that applies a low-intensity galvanic current to the scalp with the aim of stimulating specific areas of the brain. Preliminary investigations have indicated the potential therapeutic efficacy of multisession tDCS applied to the auditory cortex (AC) in the treatment of chronic tinnitus. The aim of this study was to explore the therapeutic effects of repeated sessions of bilateral tDCS targeting the AC on chronic tinnitus. A double-blinded randomized placebo-controlled trial was conducted on patients (n = 48) with chronic intractable tinnitus (>2 years duration). Participants were randomly allocated to two groups: one receiving tDCS (n = 26), with the anode/cathode placed over the left/right AC, and the other receiving a placebo treatment (n = 22). A 20 min daily session of 2 mA current was administered for five consecutive days per week over two consecutive weeks, employing 35 cm2 electrodes. Tinnitus handicap inventory (THI) scores, tinnitus loudness, and tinnitus distress were measured using a visual analogue scale (VAS), and were assessed before intervention, immediately after, and at one-month follow-up. Anodal tDCS significantly reduced THI from 72.93 ± 10.11 score to 46.40 ± 15.36 after the last session and 49.68 ± 14.49 at one-month follow-up in 18 out of 25 participants (p < 0.001). The risk ratio (RR) of presenting an improvement of ≥20 points in the THI after the last session was 10.8 in patients treated with tDCS. Statistically significant reductions were observed in distress VAS and loudness VAS (p < 0.001). No statistically significant differences in the control group were observed. Variables such as age, gender, duration of tinnitus, laterality of tinnitus, baseline THI scores, and baseline distress and loudness VAS scores did not demonstrate significant correlations with treatment response. Repeated sessions of bilateral AC tDCS may potentially serve as a therapeutic modality for chronic tinnitus.

Evidence-Based Recommendations in Primary Tracheoesophageal Puncture for Voice Prosthesis Rehabilitation.

Head and neck cancer, the seventh most common cancer worldwide, often affects the larynx, with a higher incidence in men. Total laryngectomy, a common treatment, results in the loss of phonation, and tracheoesophageal voice rehabilitation is the current rehabilitation method of choice. Despite ongoing debates regarding the timing of tracheoesophageal puncture (TEP), a crucial procedure for voice prosthesis placement, the secondary puncture continues to be the preferred choice in the majority of cases. This underscores the persistent controversy and the absence of consensus in this field. The aim of this manuscript was to define evidence-based recommendations regarding the procedure of primary TEP with voice prosthesis placement, establish the conditions and requirements for performing primary TEP, determine the indications and contraindications of primary TEP, as well as to define the complications and management of primary TEP. A total of 19 statements were formulated, with 78.95% of them having a Level of Evidence 4 and a Grade of Recommendation C. There is not sufficient evidence comparing the outcomes of primary TEP versus secondary TEP. Future studies with robust methodologies are needed to clarify the role of primary and secondary TEP in the rehabilitation of patients undergoing total laryngectomy.

Is generative pre-trained transformer artificial intelligence (Chat-GPT) a reliable tool for guidelines synthesis? A preliminary evaluation for biologic CRSwNP therapy.

INTRODUCTION: Biologic therapies for Chronic Rhinosinusitis with Nasal Polyps (CRSwNP) have emerged as an auspicious treatment alternative. However, the ideal patient population, dosage, and treatment duration are yet to be well-defined. Moreover, biologic therapy has disadvantages, such as high costs and limited access. The proposal of a novel Artificial Intelligence (AI) algorithm offers an intriguing solution for optimizing decision-making protocols. METHODS: The AI algorithm was initially programmed to conduct a systematic literature review searching for the current primary guidelines on biologics' clinical efficacy and safety in treating CRSwNP. The review included a total of 12 studies: 6 systematic reviews, 4 expert consensus guidelines, and 2 surveys. Simultaneously, two independent human researchers conducted a literature search to compare the results. Subsequently, the AI was tasked to critically analyze the identified papers, highlighting strengths and weaknesses, thereby creating a decision-making algorithm and pyramid flow chart. RESULTS: The studies evaluated various biologics, including monoclonal antibodies targeting Interleukin-5 (IL-5), IL-4, IL-13, and Immunoglobulin E (IgE), assessing their effectiveness in different patient populations, such as those with comorbid asthma or refractory CRSwNP. Dupilumab, a monoclonal antibody targeting the IL-4 receptor alpha subunit, demonstrated significant improvement in nasal symptoms and quality of life in patients with CRSwNP in several randomized controlled trials and systematic reviews. Similarly, mepolizumab and reslizumab, which target IL-5, have also shown efficacy in reducing nasal polyp burden and improving symptoms in patients with CRSwNP, particularly those with comorbid asthma. However, additional studies are required to confirm the long-term efficacy and safety of these biologics in treating CRSwNP. CONCLUSIONS: Biologic therapies have surfaced as a promising treatment option for patients with severe or refractory CRSwNP; however, the optimal patient population, dosage, and treatment duration are yet to be defined. The application of AI in decision-making protocols and the creation of therapeutic algorithms for biologic drug selection, could offer fascinating future prospects in the management of CRSwNP.

Reply to Ronsivalle, S.; Di Luca, M. Exploring the Choice of Graft Materials in Tympanoplasty: A Perspective on the Use of Temporalis Fascia and Cartilage Grafts. Comment on "Ferlito et al. Type 1 Tympanoplasty Outcomes between Cartilage and Temporal Fascia Grafts: A Long-Term Retrospective. J. Clin. Med. 2022, 11, 7000".

We sincerely appreciate the valuable insights Ronsivalle et al [...].

Validity and reliability of the Questionnaire of Olfactory Disorders for Italian-speaking patients with olfactory dysfunction.

Objective: To translate and validate an Italian version of the Questionnaire of Olfactory Disorders (IT-QOD). Materials and methods: This is a prospective, multicentre study that involved patients with olfactory dysfunction (OD). Both cases and controls underwent administration of the IT-QOD, Sino-Nasal Outcome Test-22 (SNOT-22) and psychophysical evaluation of orthonasal and retronasal olfactory function. Results: The IT-QOD was administered to 96 patients and 38 controls. The Cronbach's alpha exceeded 0.90, indicating satisfactory internal consistency. The test-retest reliability was found to be high for both parosmia (rs = 0.944) and life quality (rs = 0.969). Patients with OD had significantly higher IT-QOD scores compared to healthy individuals (p < 0.001), indicating strong internal validity. The external validity was also satisfactory, as shown by the significant correlation with SNOT-22 (rs = -0.54) and the threshold, discrimination, and identification score (rs = -0.63). Conclusions: The IT-QOD was demonstrated to be reliable and valid to assess the impact of OD on the quality of life of Italian-speaking patients.

Reliability of large language models in managing odontogenic sinusitis clinical scenarios: a preliminary multidisciplinary evaluation.

PURPOSE: This study aimed to evaluate the utility of large language model (LLM) artificial intelligence tools, Chat Generative Pre-Trained Transformer (ChatGPT) versions 3.5 and 4, in managing complex otolaryngological clinical scenarios, specifically for the multidisciplinary management of odontogenic sinusitis (ODS). METHODS: A prospective, structured multidisciplinary specialist evaluation was conducted using five ad hoc designed ODS-related clinical scenarios. LLM responses to these scenarios were critically reviewed by a multidisciplinary panel of eight specialist evaluators (2 ODS experts, 2 rhinologists, 2 general otolaryngologists, and 2 maxillofacial surgeons). Based on the level of disagreement from panel members, a Total Disagreement Score (TDS) was calculated for each LLM response, and TDS comparisons were made between ChatGPT3.5 and ChatGPT4, as well as between different evaluators. RESULTS: While disagreement to some degree was demonstrated in 73/80 evaluator reviews of LLMs' responses, TDSs were significantly lower for ChatGPT4 compared to ChatGPT3.5. Highest TDSs were found in the case of complicated ODS with orbital abscess, presumably due to increased case complexity with dental, rhinologic, and orbital factors affecting diagnostic and therapeutic options. There were no statistically significant differences in TDSs between evaluators' specialties, though ODS experts and maxillofacial surgeons tended to assign higher TDSs. CONCLUSIONS: LLMs like ChatGPT, especially newer versions, showed potential for complimenting evidence-based clinical decision-making, but substantial disagreement was still demonstrated between LLMs and clinical specialists across most case examples, suggesting they are not yet optimal in aiding clinical management decisions. Future studies will be important to analyze LLMs' performance as they evolve over time.

Exploring the potential of Chat-GPT as a supportive tool for sialendoscopy clinical decision making and patient information support.

INTRODUCTION: Sialendoscopy has emerged in the last decades as a groundbreaking technique, offering a minimally invasive approach for exploring and managing salivary gland disorders. More recently, the advent of chatbots, powered by advanced natural processing language and artificial intelligence algorithms, has revolutionized the way healthcare professionals and patients access and analyze medical information and potentially will support soon the clinical decision-making process. MATERIALS AND METHODS: A prospective, cross-sectional study was designed to assess the level of agreement between Chat-GPT and 10 expert sialendoscopists aiming the capabilities of Chat-GPT to further improve the management of salivary gland disorders. RESULTS: The mean level of agreement was 3.4 (SD: 0.69; Min: 2, Max: 4) for Chat-GPT's answers while it was 4.1 (SD: 0.56; Min: 3, Max: 5) for the group of EESS (p < 0.015). The overall Wilcoxon signed-rank test yielded a significance level of p < 0.026 when comparing the level of agreement between Chat-GPT and EESS. The mean number of therapeutic alternatives suggested by Chat-GPT was 3.33 (SD: 1.2; Min: 2, Max: 5), while it was 2.6 (SD: 0.51; Min: 2, Max: 3) for the group of EESS; p = 0.286 (95% CI - 0.385 to 1.320). CONCLUSION: Chat-GPT represents a promising tool in the clinical decision-making process within the salivary gland clinic, particularly for patients who are candidates for sialendoscopy treatment. Additionally, it serves as a valuable source of information for patients. However, further development is necessary to enhance the reliability of these tools and ensure their safety and optimal use in the clinical setting.

Facial nerve palsy following parotid gland surgery: A machine learning prediction outcome approach.

Introduction: Machine learning (ML)-based facial nerve injury (FNI) forecasting grounded on multicentric data has not been released up to now. Three distinct ML models, random forest (RF), K-nearest neighbor, and artificial neural network (ANN), for the prediction of FNI were evaluated in this mode. Methods: A retrospective, longitudinal, multicentric study was performed, including patients who went through parotid gland surgery for benign tumors at three different university hospitals. Results: Seven hundred and thirty-six patients were included. The most compelling aspects related to risk escalation of FNI were as follows: (1) location, in the mid-portion of the gland, near to or above the main trunk of the facial nerve and at the top part, over the frontal or the orbital branch of the facial nerve; (2) tumor volume in the anteroposterior axis; (3) the necessity to simultaneously dissect more than one level; and (4) the requirement of an extended resection compared to a lesser extended resection. By contrast, in accordance with the ML analysis, the size of the tumor (>3 cm), as well as gender and age did not result in a determining favor in relation to the risk of FNI. Discussion: The findings of this research conclude that ML models such as RF and ANN may serve evidence-based predictions from multicentric data regarding the risk of FNI. Conclusion: Along with the advent of ML technology, an improvement of the information regarding the potential risks of FNI associated with patients before each procedure may be achieved with the implementation of clinical, radiological, histological, and/or cytological data.

Influence of Otolaryngological Subspecialties on Perception of Transoral Robotic Surgery: An International YO-IFOS Survey.

BACKGROUND: To investigate perception, adoption, and awareness on the part of otolaryngology and head and neck surgeons (OTO-HNS) of transoral robotic surgery (TORS). METHODS: Several items assessed: awareness/perception; access to TORS; training; indications and advantages/hurdles to TORS practice. A subanalysis was performed to assess differences according to the identified otolaryngological subspecialties. RESULTS: A total of 359 people completed the survey. Among subspecialties, while for otolaryngologists 30/359 (8.4%) and H&N surgeons 100/359 (27.9%) TORS plays an effective role in hospital stay, laryngologists frequently disagreed (54.3%). There was a lower incidence among rhinologists and otologists (1.9%). Pediatric surgeons (0.8%) reported a positive response regarding the adoption of robotic surgery, and head and neck specialists expressed an even greater response (14.2%). Low adherence was related to perceived cost-prohibitive TORS, by 50% of H&N surgeons. CONCLUSIONS: Perception, adoption, and knowledge about TORS play a key role in the application of the robotic system, significantly varying across subspecialties.

Velopharyngeal Incompetence in Musicians: A State-of-the-Art Review.

The velopalatine sphincter is a muscular valve that creates a hermetic seal between the nasopharynx and the oropharynx. It guarantees phonation, swallowing, and breathing (forces expirations). In wind musicians, sphincter closure must be precise during sound generation. Its failure will cause velopharyngeal incompetence (VPI) and the end of professional success. The objective of this article was to conduct a state-of-art review of VPI in wind musicians with a systematic approach based on the PRISMA Statement. The etiology, epidemiology, clinic, diagnosis, and treatment of VPI in wind musicians were evaluated. The research was carried out in different databases (PubMed/MEDLINE, the Cochrane Library, Scielo) and through the Mergullador metasearch engine. A total of 20 publications were selected. VPI is a pathology that affects around one-third of wind musicians according to studies. It causes pharyngeal noises and nasal air emissions during performance. The main etiology seems to be the fatigue of the velopalatine sphincter muscles. The most used diagnostic techniques consist of clinical history, physical examination, and nasofibroscopy. There is no consensus among authors about therapeutic management. Future investigations are necessary to confirm that fatigue of velopalatine sphincter muscles and other factors that increase it are the main causes of VPI in wind musicians.

Marginal versus Segmental Mandibulectomy in the Treatment of Oral Cavity Cancer: A Systematic Review and Meta-analysis.

Introduction Oral cavity squamous cell carcinoma (OCSCC) is the most common malignancy in the oral cavity. Two types of mandibular resections have been described: the segmental mandibulectomy and the marginal mandibulectomy. Both may have a different impact over the quality of life, oncological prognosis, and functional or aesthetic result. Objectives The aim of this study was to systematically explore the literature to determine the survival outcomes and disease control rates in patients who underwent segmental or marginal mandibulectomy for OCSCC with histological evidence of cortical and medullary bone invasion. Data Synthesis This review involved a systematic search of the electronic databases MEDLINE/PUBMED, Google Scholar, Ovid Medline, Embase, and Scopus including articles from 1985 to 2019. Fifteen articles were included for qualitative analysis and 11 articles were considered for meta-analysis calculations. All of them correspond to retrospective cohort studies. Conclusion This systematic review reveals the low-level evidence regarding the impact over local control or survival according to the type of mandibulectomy. Our results need to be considered with precaution according to the limited evidence available. We just found difference regarding the 5-year disease-free survival, and a tendency in favor of segmental mandibulectomy was confirmed when medullary invasion was evident.